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1.  INTRODUCTION 


This  contract  covered  the  period  April  15,  1994  through  December  31,  1997.  It 
supported  Professor  Peter  W.  Glynn  for  two  months  in  the  summer  and  Professor  Donald 
L.  Iglehart  for  one  month  in  the  summer. 

Our  work  on  simulation  methodology  begins  with  the  formulation  of  a  model  as  a 
stochastic  process.  We  then  use  the  structure  of  the  stochastic  process  to  develop 
methods  for  analyzing  the  output  of  the  simulation.  Diagram  1  is  a  block  diagram  which 
details  our  approach  to  system  simulation.  The  performance  evaluation  and  reliability 
analysis  of  complex  engineering  systems  requires  an  ability  to  analyze  mathematical 
models  of  these  systems.  Large-scale  stochastic  models  are  required  to  handle  various 
uncertainties  present  in  these  systems.  Unfortunately,  the  complexity  of  most  stochastic 
models  of  real  systems  is  well  beyond  our  ability  to  apply  classical  mathematical 
analysis.  Computer  simulation  of  stochastic  systems  has  become  one  of  the  principal 
alternatives  to  classical  analysis.  The  main  thrust  of  our  research  is  improving  the 
efficiency  of  simulation  methods  and  extending  their  applicability  to  wider  class  of 
stochastic  systems.  We  also  carry  out  research  on  a  variety  of  stochastic  models  with  the 
aim  of  obtaining  closed  form  solutions  or  approximations. 

2.  IMPORTANT  RESULTS  OBTAINED 

High  speed  communications  networks  of  the  future  are  expected  to  use  the  asynchronous 
transfer  mode  (ATM)  protocol  to  simultaneously  carry  data,  voice,  and  video  traffic. 
This  traffic  flows  into  a  switch  which  is  modeled  as  a  single  serve  in  a  queueing  network. 
The  design  and  control  of  such  networks  involves  the  appropriate  sizing  of  buffers  used 
to  store  message  packets.  The  asymptotic  decay  rate  for  the  tail  of  the  steady-state 
waiting  time  distribution  has  been  derived.  This  decay  rate  may  be  used  to  create 
effective  bandwidths  for  admission  control  and  other  network  resource  allocation 
problems.  These  rates  can  also  be  used  to  speed  up  simulations  of  the  network.  Steady- 
state  performance  measures  for  highly  dependable  systems  (such  as  fault-tolerant 
computer  systems)  are  estimated  by  simulations  involving  rare  events.  Earlier  work  dealt 
with  Markovian  systems  that  could  be  formulated  as  regenerative  processes.  Our  current 
work  assumes  that  repair  and  failure  times  are  non-exponential  and  this  leads  to  non- 
Markovian  systems  for  which  the  regenerative  structure  is  lost.  A  new  approach  has  been 
developed  using  importance  sampling  applied  to  a  sequence  of  cycles  which  are  no 
longer  independent,  identically  distributed  as  in  the  regenerative  case.  Experimental 
results  show  that  the  method  is  effective  in  practice.  Techniques  have  been  developed  for 
estimating  the  gradient  of  performance  measures  with  respect  to  design  parameters. 
These  gradient  estimates  are  required  for  sensitivity  analyses  and  system  optimization. 
System  simulations  are  a  natural  candidate  for  parallel  processing.  A  simple  way  to 
exploit  the  power  of  parallel  processing  is  to  run  multiple  independent  replications  in 
parallel  and  average  the  results.  Whether  estimating  transient  or  steady-state  quantities,  a 
number  of  problems  arise  that  can  lead  to  incorrect  estimates.  We  have  developed  a 
number  of  techniques  for  overcoming  these  problems.  Solutions  of  Poisson’s  equation 
provide  the  key  to  studying  the  bias  and  variability  of  additive  functionals  of  a  Markov 


Diagram  1.  Technical  Approach  to  System  Simulation* 
_ *Our  emphasis  is  on  the  shaded  boxes 


chain.  These  solutions  have  been  obtained  for  discrete  and  continuous  time  Markov 
chains,  and  for  the  waiting  time  sequence  of  the  single  server  queue. 

The  maximum  of  a  random  walk  over  the  non-negative  integers  is  an  important  random 
variable  that  arises  in  insurance  risk  theory,  sequential  analysis,  and  queueing  theory.  We 
developed  a  method  for  simulating  the  exact  distribution  of  this  maximum  along  with 
several  ways  to  reduce  the  variance  of  our  estimator.  In  manufacturing  environments  one 
is  often  concerned  with  optimizing  the  performance  of  a  system  over  a  set  of  decision 
parameters,  when  the  performance  can  only  be  evaluated  through  simulation.  We  study 
how  fast  the  number  of  simulation  replications  must  grow  as  the  number  of  gird  points  in 
the  decision  space  increases.  For  non-irreducible,  general  state  space  Markov  chains  we 
developed  a  criteria  for  guaranteeing  tightness  of  the  chains.  Tightness  is  a  condition  that 
guarantees  that  Markov  chains  are  well  behaved  in  the  limit  as  time  becomes  large.  The 
shortest  processing  times  scheduling  rule  is  shown  to  be  asymptotically  optimal  when 
processing  times  are  exchangeable  across  machines  and  independent  across  jobs.  In 
steady-state  simulations  estimating  the  time-average  variance  constant  (TAVC)  is  critical 
for  obtaining  confidence  intervals  of  performance  measures.  Several  methods  for 
estimating  the  TAVC  have  been  developed  in  the  literature.  We  have  studied  the 
computational  complexity  of  these  estimates  for  the  various  methods.  A  continuous  time 
Markov  process  is  governing  by  its  infinitesimal  generator.  An  important  problem  when  - 
observing  financial  time  series  is  to  estimate  this  generator  when  the  process  is  only 
observable  at  random  times.  We  developed  a  family  of  generalized  method-of-moment 
estimators  for  this  problem,  the  maximum-likelihood  estimator  being  a  special  case.  We 
established  strong  consistency,  asymptotic  normality,  and  characterization  of  the  standard 
errors  for  these  estimators. 
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